The document discusses rubrics, which are tools that explicitly define the criteria for assignments and assessments. There are two main types of rubrics: analytic rubrics, which have multiple detailed criteria assessed on different levels of performance, and holistic rubrics, which assess performance across criteria as a whole on a single scale. The document provides guidance on developing effective rubrics, including choosing the appropriate type, creating clear criteria and performance level descriptions, and ensuring usability for both teachers and students.
Convert to study materialsBETA
Transform any presentation into ready-made study materialselect from outputs like summaries, definitions, and practice questions.
2. Whats a rubric?
Analytic rubrics have
Levels of performance
Multiple criteria
09/17/12 2
3. "Rubrics" explicitly state criteria for
assignments.
May lead to a grade or be part of
the grading process.
Are more specific, detailed, and
disaggregated than a grade.
Show strengths and weaknesses in
student work.
09/17/12 3
4. Another definition
Assess student performance along
a task-specific set of criteria
Measures performance against a
predetermined criteria
Includes essential criteria for the
task
Has multiple levels of performance
09/17/12 4
5. Characteristics of Rubrics
Increase an assessment's construct and
content validity
Increase an assessment's reliability
set criteria that raters can apply consistently
and objectively
Established criteria reduces bias
Can help teachers clarify goals and
improve their teaching
Help learners set goals and assume
responsibility for their learning
09/17/12 5
6. Characteristics Continued
Help learners develop their ability to
judge quality in their own and
others' work
Provides specific feedback about
areas of strength and weakness
Learners can use rubrics to assess
their own effort and performance
before submitting it
09/17/12 6
7. Characteristics Continued
Learners and teachers monitor
progress over a period of instruction
Reduces time spent grading
Engaging students in the design
empowers them
Moves away from subjective
grading
09/17/12 7
8. Types of Rubrics
Ask yourself:
For a particular task, do you want to
be able to assess how well the students
perform on each criterion, or do you
want to get a more global picture of
the students' performance on the
entire task?
09/17/12 8
9. Holistic
a holistic rubric does not list
separate levels of performance for
each criterion
a holistic rubric assigns a level of
performance by assessing
performance across multiple criteria
as a whole.
09/17/12 9
10. Holistic Example
3 - Excellent Researcher
included 10-12 sources
no apparent historical inaccuracies
can easily tell which sources information was drawn from
all relevant information is included
2 - Good Researcher
included 5-9 sources
few historical inaccuracies
can tell with difficulty where information came from
bibliography contains most relevant information
1 - Poor Researcher
included 1-4 sources
lots of historical inaccuracies
cannot tell from which source information came
bibliography contains very little information
09/17/12 10
12. When to choose an analytic
rubric
Want to assess each criterion
separately
Involve large number of criteria
More variance across the criteria
Need to weight criteria differently
09/17/12 12
13. Designing an Analytic Rubric
Step 1. Re-examine learning objective to be
addressed by the task.
Step 2. Identify observable attributes you want to
see (as well as those you dont want to see) your
students demonstrate in the product, process, or
performance.
Step 3. Brainstorm characteristics of each attribute.
09/17/12 13
14. Design Analytic Continued
Step 4b. Write thorough narrative
description for excellent and poor work for
each individual attribute.
Step 5b. Complete the rubric by describing
other levels on the continuum that ranges
from excellent to poor for each attribute.
09/17/12 14
15. Hint: Use Even Number of
Levels
Use an even number (4 or 6) of levels
of performance on the scale.
When there are an odd number of
levels, the middle level tends to
become a catch-all category.
With an even number of levels, raters
have to make a more precise judgment
about a performance when its quality is
not at the top or bottom of the scale.
09/17/12 15
16. Hint: Arrange Levels Low to
High
Low to High scale.
Students read first the description of
an exemplary performance in each
criterion.
09/17/12 16
17. Sample High to Lows
1 2 3 4
Unacceptable Acceptable Excellent Exemplary
Not there yet Progressing Meets Exceeds
expectations expectations
Needs work Fair Good Superior
09/17/12 17
18. More Hints
Limited number of dimensions or criteria.
The criteria are those components that are
most important to evaluate in the given task
and instructional context.
A rubric with too many dimensions may be
unworkable in classroom assessment.
Equal steps along the scale.
The difference between 4 and 3 should be
equivalent to the difference between 3 - 2
and 2 - 1.
"Yes, and more", "Yes", "Yes, but", and "No"
09/17/12 18
20. 4 3 2 1
Task All Most Some Very few or none
Frequency Always Usually Some of the time Rarely or not at
all
Accuracy No errors Few errors Some errors Frequent errors
Comprehen Always Almost always Gist and main Isolated bits are
sibility comprehen comprehensible ideas are comprehensible
sible comprehensible
Content Fully Adequately Partially Minimally
coverage developed, developed, developed, developed,
fully adequately partially supported minimally
supported supported supported
Vocabulary
Range Broad Adequate Limited Very limited
Variety Highly Varied; occasionally Lacks variety; Memorized;
varied; non- repetitive repetitive highly repetitive
repetitive
09/17/12 20
21. Chocolate Chip Cookies
Break into pairs.
Compete the worksheet Creating a Rubric.
Create a rubric for judging the quality of a
chocolate chip cookie.
-Be sure to decide if you want to do a holistic or
analytic rubric!!!!
Be prepared to defend your decision.
Use the handout on Rubric Examples to help
you when you get stuck!
When you all finished, you will get to judge
the cookies using the different rubrics.
09/17/12 See Lesson Builder Page 9 for 21
Handouts
22. Using RubiStar
These are some simple steps for
getting started with Rubistar.
Access the site
http://rubistar.4teachers.org.
Take a moment to read about the
different features.
When you are ready to get started,
click on the tutorial and choose the
option you prefer.
09/17/12 22
23. Rubistar Tips
If you are using Internet Explorer, you can
copy the rubric and paste it into a Word
document where you can continue to edit.
When first getting started, you might want to
choose an existing template.
You may find that you can create a rubric you
like by combining existing rubrics into one of
your own.
You can do this by opening two windows to
Rubistar and copying and pasting between
windows.
09/17/12 23
24. Assignment
Create a rubric for an
objective/competency you have for a
class you teach.
Use the worksheet on creating a rubric
to get you started.
Divide into teams.
Exchange rubrics and use the Aunt
Olive's Rubric on Rubrics to provide
feedback to a colleague on their work.
09/17/12 Lesson Builder Page 10 24
25. Review
1. Describe a rubric (what is it).
2. Describe the purpose of rubrics.
3. Describe the difference between holistic
and analytic rubrics.
4. List the characteristics of good rubrics.
5. Develop a rubric for judging the quality of a
product (chocolate chip cookie).
6. Create/modify a rubric for an assignment or
activity in a class you teach.
7. Identify strengths and weaknesses in a
rubric.
09/17/12 25
Editor's Notes
#3: Page 4 LB, page 5 handout Explain how the printed handout works, where to find the materials in Blackboard, and slideshare.net/chedisky/slideshows Common rubrics are designed in a matrix. Many rubrics are designed as a matrix with Levels of performance across the columns (top) Criterion along the rows on the left.
#4: Page 4 LB, page 5 handout TLT--Teaching, Learning, Technology Group which manages the Flashlight Projects developed this http://www.tltgroup.org/resources/Flashlight/Rubrics.htm
#5: LB page 4, handout page 5 Jon Mueller http://jonathan.mueller.faculty.noctrl.edu/toolbox/rubrics.htm That is, a student's aptitude on a task is determined by matching the student's performance against a set of criteria to determine the degree to which the student's performance meets the criteria for the task. To measure student performance against a pre-determined set of criteria, a rubric, or scoring scale, is typically created which contains the essential criteria for the task and appropriate levels of performance for each criterion.
#6: Page 5 in LB, page 8 handout Well-designed rubrics increase an assessment's construct and content validity by aligning evaluation criteria to standards, curriculum, instruction, and assessment tasks. Well-designed rubrics increase an assessment's reliability by setting criteria that raters can apply consistently and objectively. Evaluating student work by established criteria reduces bias. Identifying the most salient criteria for evaluating a performance and writing descriptions of excellent performance can help teachers clarify goals and improve their teaching. Rubrics help learners set goals and assume responsibility for their learningthey know what comprises an optimal performance and can strive to achieve it. From: University of Minnesotas Virtual Assessment Center http://www.carla.umn.edu/assessment/VAC/Evaluation/p_5.html
#7: Page 5 in handout continued Rubrics used for self- and peer-assessment help learners develop their ability to judge quality in their own and others' work. Learners receive specific feedback about their areas of strength and weakness and about how to improve their performance. Learners can use rubrics to assess their own effort and performance, and make adjustments to work before submitting it for a grade.
#8: Page 5 Lesson Builder Rubrics allow learners, teachers, and other stakeholders to monitor progress over a period of instruction. Time spent evaluating performance and providing feedback can be reduced. When students participate in designing rubrics, they are empowered to become self-directed learners. Rubrics help teachers move away from subjective grading by allowing them and others, including students themselves, to assess work based on consistent, often agreed upon, and objective criteria.
#22: Page 9 LB. Page 19 handout The handout includes the examples and form from the LB lesson. Students can open the pdf forms from LB to do this assignment. They can reference the handout if they want a hard copy. Be sure that they see that the form includes options for either holistic or analytic.